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Abstract 

In a recent breakthrough [CZ15], Chattopadhyay and Zuckerman gave an explicit two-source 
extractor for min-entropy k > log*^ n for some large enough constant C. However, their extractor 
only outputs one bit. In this paper, we improve the output of the two-source extractor to 
while the error remains 

Our improvement is obtained by giving a better extractor for (g, t, 7 ) non-oblivious bit-fixing 
sources, which can output bits instead of one bit as in [CZI5]. 


1 Introduction 


In theoretical computer science and in particular the area of pseudorandomness, one deals with 
the problem of either reducing the number of random bits used in applications (ideally, completely 
removing the use of random bits) or replacing the uniform random bits needed by random sources 
with very weak quality. The former is done by constructing pseudorandom generators and the latter 
is done by constructing randomness extractors. Both objects have been the focus of extensive study 
over the past several decades. 

In this paper, we focus on randomness extractors and in particular we study the problem of 
constructing randomness extractors for independent general weak random sources, where a weak 
random source is modeled by a distribution with a certain amount of entropy. 

Definition 1.1. The min-entropy of a random variable X is 

HooiX) = min log 2 (l/Pr[X = x]). 

xGsupp(X) 

For X G {0, !}”■, we call X an {n, Hoo{X))-source, and we say X has entropy rate Hoo{X)/n. 

A well known result is that with just one weak source as input, no deterministic extractor 
can work for all {n,k) sources even when k = n — 1. Due to this, there have been two different 
directions and relaxations for randomness extractors. The first one is to give the extractor an 
additional independent uniform random seed, which is generally much shorter than the source 
(e.g., O(logn)). These extractors are called seeded extractors and were introduced by Nisan and 
Zuckerman [NZ96]. 

Definition 1.2. (Seeded Extractor) A function Ext : {0,1}” x {0,1}'^ —>■ {0,1}™' is a (A;, e)-extractor 
if for every source X with min-entropy k and independent Y which is uniform on {0,1}'^, 

|Ext(A,y)-[/^| <e. 

If in addition we have |(Ext(A, T),T) — {Um-,Y)\ < e then we say it is a strong {k,e)-extractor. 

With the help of the extra seed, it is now indeed possible to construct extractors for all weak 
random sources. Seeded extractors have found numerous applications in theoretical computer 
science, and today we have nearly optimal constructions of such extractors (e.g., [LRVW03, GUV09, 
DW08, DKSS09]). 

In the other direction, one considers building deterministic extractors for sources which have 
special structures. In this case, one important class of sources is the so called independent sources. 
Here, the extractor is given as input more than one general weak random sources, and the sources 
are independent each other. Using the probabilistic method, one can show that there exists a 
deterministic extractor for just two independent sources with logarithmic min-entropy, which is 
optimal since extractors for one weak source do not exist. In fact, the probabilistic method shows 
that with high probability a random function is such a two-source extractor. However, the most 
interesting and important part is to give explicit constructions of such functions, which turns out 
to be highly challenging. 

The first explicit construction of a two-source extractor appeared in [CG88], where Chor and 
Goldreich showed that the well known Lindsey’s lemma gives an extractor for two independent 
(n, k) sources with k > n/2. Since then there has been essentially no progress on two-source 
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extractors until in 2005 Bourgain [Bou05] gave a construction that breaks the entropy rate 1/2 
barrier, and works for two independent (n, 0.49n) sources. In a different work, Raz [Raz05] gave an 
incomparable result of two source extractors which requires one source to have min-entropy larger 
than n/2, while the other source can have min-entropy O(logn). 

Given the difficulty of constructing explicit two-source extractors, much research has been 
focusing on a slightly more general model, where the extractor is allowed to have more then two 
independent sources as the input. Starting from [BIW04], there has been a long line of fruitful 
results [BIW04, Raz05, Bou05, RaoOG, BRSW06, Bill, Lil3b, Lil3a, Lil5, Cohl5], which introduced 
many new techniques and culminated in the three source extractor of exponentially small error by 
the author [Lil5]. However, in the two source case the situation has not been improved. 

Recently, Chattopadhyay and Zuckerman [CZ15] made an exciting breakthrough to the problem 
of constructing explicit two-source extractors. They gave an explicit two-source extractors for (n, k) 
sources with k > log^ n for some large enough constant C. This dramatically improves the situation 
of two-source extractors and is actually near optimal. However, their construction only outputs 
one bit. 

In this paper, we improve the output length of the two-source extractor in [CZ15] to k^^^\ 
Specifically, we have the following theorem. 

Theorem 1.3. (Main theorem). There exists a constant C > 0 such that for all n € N, there exists 
a polynomial time computable funetion 2Ext : {0,1}” x {0, !}"■ —>■ {0,1}”* satisfying the following: 
if X,Y are two independent {n,k) sources with k > log^n, then 

\{2Ext{X,Y),Y)-{Um,Y)\<e, 

where m = and e = 

Since the extractor is strong in Y, if we don’t need a strong extractor, then we can use the 
output of 2Ext to extract from Y and output almost all the min-entropy. For example, we have the 
following theorem. 

Theorem 1.4. There exists a constant C > 0 such that for all n £ N, there exists a polynomial 
time eomputable function 2Ext : {0,1}"' x {0,1}" —)■ {0,1}™' satisfying the following: if X,Y are 
two independent (n, k) sources with k > log*^ n, then 

\2Ext{X,Y)-Um\<e, 

where m = 0.9k and e = . 

1.1 Non-Oblivious Bit-Fixing Sources 

As in [CZ15], our construction is also based on reducing two independent sources to a special kind 
of non-oblivious bit-fixing source. Following [CZ15], we formally define such sources. 

Definition 1.5. A distribution "D on n bits is t-wise independent if the restriction of "D to any t 
bits is uniform. Further P is a (t, e)-wise independent distribution if the distribution obtained by 
restricting V to any t coordinates is e-close to uniform. 
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Definition 1.6. A source X on {0,1}”' is called a (g, t)-non-oblivious bit-fixing source if there 
exists a subset of coordinates Q C [n] of size at most q such that the joint distribution of the bits 
indexed by Q = [n] \Q is t-wise independent. The bits in the coordinates indexed by Q are allowed 
to arbitrarily depend on the bits in the coordinates indexed by Q. 

If the joint distribution of the bits indexed by Q is (t, yj-wise independent then X is said to be 
a (g, t, 7 )-non-oblivious bit-fixing source. 

Our main theorem of the improved two-source extractor actually follows directly from our 
improvement of the extractor for a (< 7 , t, yj-non-oblivious bit-fixing source in [CZ15]. Specifically, 
we have the following theorem. 

Theorem 1.7. There exists a constant c such that for any constant 5 > 0 and all n G N, there exists 
an explicit extractor BFExt : {0,1}” —>■ {0,1}”* such that for any {q,t,^) non-oblivious bit-fixing 
source X on n bits with q < , t > clog^^ n and 7 < l/n*+^, we have that 

\BfExt{X) - Um\ < €, 

where m = and e = 

Table 1 summarizes our results compared to previous constructions of independent source ex¬ 
tractors. Note that in the table the output length are all under the conditions of being strong 
extractors. 

1.2 Overview of The Constructions and Techniques 

Here we give a brief overview of our constructions and the techniques. We first describe our new 
extractor for the {q,t,'j) non-oblivious bit-fixing source on n bits with q < for some constant 
(5 > 0, and 7 < Our starting point is the one-bit deterministic extractor for such sources 

in [CZ15], which we’ll call BitExt. We note that from the construction of [CZ15], (by setting the 
parameters appropriately) this function has the following properties. First, it is a depth-4 AC° 
circuit with size . Second, since it’s an extractor, for any (q,t,'y) non-oblivious bit-fixing 
source X, we have BitExt(X) is n“^^^^-close to uniform. Third, it’s a resilient function, in the sense 
that any coalition of any q bits has influence at most qfn^~ 2 . 

We now describe how to extract more than one bit. One natural idea is to divide the source X 
into many blocks and then apply BitExt to each block. Indeed this is our first step. In the source 
X, we denote the “bad bits” by Q, and the “good bits” by Q. To ensure that no block consists of 
only bad bits, we will divide X into n“ blocks for some constant a < (5 (it suffices to take a = 5/4). 
Thus we get i = n° blocks {Xi,i G [£]} with each block containing n' = bits. We now apply 
BitExt to each block to obtain a bit Yi. Of course, we will set up the parameters such that BitExt 
is an extractor for {q,t,'y) non-oblivious bit-fixing source on bits. 

Now consider any block. Our observation is that since each block can contain at most q < 
bits from Q, the coalition of the bad bits in this block still has small influence. In particular, by 
a simple calculation shows that q<n 4 and thus for each block the influence of the bad bits is 
bounded by q/n » < n s . This means that with probability at least 1 — n s over the fixing 
of Xi n Q, we have that 1} is fixed. Thus, by a simple union bound, with probability at least 
1 — n"n““8‘ = 1 — n~8 over the fixing of Q, we have that all {!}, f G [£]} are fixed. 

Now consider another distribution X', which has the same distribution as X for the bits in Q, 
while the bits in Q are fixed to 0 independent of the bits in Q. We let T/, i G [1] be the corresponding 
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Construction 

Number of Sources 

Min-Entropy 

Output 

Error 

[CG88] 

2 

k> (1/2-1- 5)n, any constant 5 

0(re) 


[BIW04] 

poly(l/5) 

Sn, any constant 6 

0(re) 


[BKS+05] 

3 

5n, any constant 5 

0(1) 

0(1) 

[RazOS] 

3 

One source: 5n, any constant 6. Other 
sources may have k > polylog(n). 

0(1) 

0(1) 

[Raz05] 

2 

One source: (1/2 -|- 5)n, any constant 6. 
Other source may have k > poly log (n) 

e{k) 

2-n(k) 

[BouOS] 

2 

{1/2 — ao)n for some small universal 
constant ao > 0 

0(re) 

<2—Q{n) 

[Rao06] 

3 

One source: 5n, any constant 6. Other 
sources may have k > polylog(n). 

Q{k) 


[Rao06] 

0(logn/ log k) 

k > polylog(n) 

&{k) 

FWT 

[BRSW06] 

0(logn/ log k) 

k > polylog(n) 

eik) 


[Till] 

3 

k = any constant S 

e{k) 

FWR 

[LilSb] 

0(log(S)) + 0(1) 

k > polylog(n) 

eik) 

k-n{i) 

[Lil3a] 

0(^) + 0(l), 

0(1) can be large 

k > log^^*^ n 

e{k) 

re-*Hi) + 

[Lil5] 

3 

k > log^^ n 

e{k) 


[Lil5] 

r^i+2 

k > log^“'“*^ n 

e{k) 


[Cohl5] 

3 

6n, 0(log re), 0(log log re) 

0 (log re) 

(logre)“^di) 

[CZ15] 

2 

k > log*^ re for some large constant C. 
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This work 

2 

k > log*^ re for some large constant C. 




Table 1: Summary of Results on Extractors for Independent Sources. 


YiS obtained from X' instead of X. By the above argument, with probability at least 1 — n s 
over the fixing of Q, {Yi} and are the same. Thus the joint distribution of {Yi} and \Yl'\ are 
within statistical distance n~». Moreover, the bits in Q are (t, 7 )-wise independent and thus they 
are n *7 < 1/n-close to a truly t-wise independent distribution. From now on we will treat Q as 
being truly t-wise independent, since this only adds 1/n to the final error. 

We will now choose a parameter m = for the output length. In addition, we take the 
generating matrix G of an asymptotically good linear binary code with message length m, codeword 
length r = 0{m) and distance d = n(m). It is well known how to construct such codes (and thus the 
generating matrix) explicitly. Note that G is an m x r matrix and any codeword can be generated 
hy w = vG for some vector v G {0,1}”*, where all operations are in F 2 . We choose m so that 
r = 0{m) < i and now we let Y = (li, • • • ,1}) be the random vector in F^. Similarly, we have 
Y' = {Y(, ■ ■ ■ ,Y^). The output of our extractor will now be Z = (Zi, • • • , Zm) = GY, where all 
operations are in F 2 . 

For the analysis let us consider Z' = (Z[, ■ ■ ■ , Z'^) = GY'. We will show that Z' is close to 
uniform and then it follows that Z is also close to uniform since they are within statistical distance 
(since they are deterministic functions of Y and Y' respectively). To show this, we will use 
the XOR lemma. Consider any non-empty subset S C [m] and Vg = 0iGS Z}. Note that this is 
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just (X]jg 5 Gi)Y' where Gi stands for the i’th row of G. Note that Gi is a codeword and thus 
has at least d = Q{m) I’s. On the other hand, it can have at most r = 0{m) I’s. 

Note that the parity of up to r bits can be computer by a depth-2 fKOP circuit of size 20 (r) ^ 
20 [m) ^ Recall that each input bit Yi can be computed by a depth-4 AC° circuit of size Thus 

we see that each Vg can be computed by a depth-6 AC° circuit of size at most ^ 20 {m) 

if we choose m > logn. ^ Note that all bits in Q are fixed to 0. Thus the inputs of the circuits are 
only from Q. 

Now our goal is to ensure that can be fooled by t-wise independent distributions with 
error e = 2“™'. By the theorem of Braverman [BralO] and Tal [Tall4], it suffices to take t = 
0(log(2'^(™')/e)^^) = Thus we can take m = On the other hand, if Q are the 

uniform distribution, then Vg is the XOR of at least d = n(m) independent random variables, 
with each being n“^(^)-close to uniform. Thus in this case is = 2“^(”^^°®"')-close to 

uniform. Together this means that is -|- 2“™' < 2^“™ close to uniform. Since this is 

true for any non-empty subset S, by a standard XOR lemma it now follows that Z' is 2“^(™^-close 
to uniform. Adding back the errors we see that Z is n“^(^)-close to uniform. 

Applying the reduction from two independent sources to a non-oblivious bit-fixing source, we 
immediately obtain our improved two-source extractor. 

Organization. The rest of the paper is organized as follows. We give some preliminaries in 
Section 2. We present our main construction of extractors in Section 3, and we conclude with some 
discussions and open problems in Section 4. 

2 Preliminaries 

We often use capital letters for random variables and corresponding small letters for their instanti¬ 
ations. Let [S'! denote the cardinality of the set S. For i a positive integer, Ui denotes the uniform 
distribution on {0,1}^. When used as a component in a vector, each is assumed independent of 
the other components. All logarithms are to the base 2. 

2.1 Probability distributions 

Definition 2.1 (statistical distance). Let W and Z be two distributions on a set S. Their statistical 
distance (variation distance) is 

A(W, Z) "1/ max(|W(r) - Z(T)|) = i |W(s) - Z(s)|. 

“ sGS 

We say W is e-close to Z, denoted W «£ Z, if A{W,Z) < e. For a distribution D on a set S 
and a function h : 5 — )• T, let h{D) denote the distribution on T induced by choosing x according 
to D and outputting h{x). 

2.2 Influence of variables 

Following [CZ15], we define the influence of variables. 

^We can get rid of the intermediate negation gates with only a constant factor of blow-up in the circuit size, by 
standard tricks. 
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Definition 2.2. Let / : {0,1}"^ {Oj 1} be any boolean function on variables xi,--- ,Xn- The 
influence of a set Q C {xi, • • • , x„} on /, denoted by Iq(/), is defined to be the probability that / 
is undetermined after fixing the variables outside Q uniformly at random. Further, for any integer 
q define Ig(/) = maxQc{xi,...,n;„},|Q|=glQ(/)- 

More generally, let denote the probability that / is undermined when the variables 

outside Q are fixed by sampling from the distribution D. We define £>(/)) 

where Dt is the rest of all t-wise independent distributions. Similarly, lq^t,-y{f) = ^CLXDeDt,j^Q,D{f) 
where is the set of all (t, 7 )-wise independent distributions. Finally, for any integer q define 

,Xn},\Q\=q^Q,t{f) ,Xn},\q\=q^Q,t,-fif) 

2.3 Prerequisites from previous work 

Lemma 2.3 ([BIW04]). Assume that Yi,Y 2 , ■ ■ ■ ,Yt are independent random variables over {0, 1}” 
such that for any i, 1 < i < t, we have \Yi — Un\ < e. Let Z = Then \Z — Un\ < eh 

To prove our construction is an extractor, we need the following definition and lemma. 

Definition 2.4. (e-biased space) A random variable Z over {0,1} is e-biased if | Pr[Z = 0] — Pr[Z = 
1]| < e. A sequence of 0-1 random variables Zi,--- ,Zm is e-biased for linear tests if for any 
nonempty set S C {1, • • • , m}, the random variable Zs = Zi is e-biased. 

The following lemma is due to Vazirani. For a proof see for example [Gol95] 

Lemma 2.5. Let Zi, - ■ ■ , Zm be 0-1 random variables that are e-biased for linear tests. Then, the 
distribution of (Zi, • • • , Z^) is e ■ T^l'^-close to uniform. 


3 The Constructions of Extractors 

In this section we describe our deterministic extractor for an (q, t, 7 )-non-oblivious bit-fixing source 
on n bits. We rely on the following result from [CZ15]. 

Theorem 3.1 ([CZ15]). There exists a constant c > 0 such that for any 5 > 0 and every large 
enough n € N the following is true. Let X be a {q,t,^) non-oblivious bit-fixing source on n bits 
with q < , t > clog^®n and 7 < There exists a polynomial time computable monotone 

boolean function BitExt : {0,1}” —?> {0,1} satisfying: 

• BitExt is a depth 4 circuit in AC*^ of size 

• |E,,^x[BitExt(x)] - i| < 

• For any <? > 0, Ig^i^.y(BitExt) < qln^~^. 

We need the following result by Braverman [BralO] and Tal [Tall4] about fooling AC*^ circuits 
with t-wise independent distributions. 

Theorem 3.2 ([BralO, Tall4]). Let V be any t = t{m,d,e)-wise independent distribution on 
{0,1}”". Then for any circuit C € AC° of depth d and size m, 

\Exr^uAC{x)] - E,,r^T>[C{x)]\ < e, 

where t{m,d,e) = 0{\og{m/. 
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Theorem 3.3 ([AGM03]). Let D he a {t,'y)-wise independent distribution on {0,1}”. Then there 
exists a t-wise independent distribution on {0,1}” that is n^^-close to V. 

We also need an explicit asymptotically good binary linear codes: 

Definition 3.4. A linear binary code of length n and rank fc is a linear subspace C with dimension 
k of the vector space . If the distance of the code C is d we say that C is an [n, k, d ]2 code. C is 
asymptotically good if there exist constants 0 < di, <52 < 1 s.t. k > 6 in and d > 62 n. 

Note that every linear binary code has an associated generating matrix G G and every 

codeword can be expressed as vG, for some vector u G F^. 

It is well known that we have explicit constructions of asymptotically good binary linear code. 
For example, the Justensen codes constructed in [Jus72]. 

Now we have the following construction and theorem: 

We now present our extractor for a {q, t, 7 ) non-oblivious bit-fixing source. 


Algorithm 3.5 (BFExt(A) ). 

Input: X — a {q,t,^) non-oblivious bit-fixing source on n bits with q < n^~^, t > clog^^ n and 

Output: Z — a string on m bits that is close to uniform, with m = t^^^\ 

Sub-Routines and Parameters: 

Let a = (1/4. Let BitExt be the one-bit extractor for non-oblivious bit-fixing source in The¬ 
orem 3.1. Let G be the generating matrix of an asymptotically good [r, m, d ]2 code with 
r = 0{m) < n“ and d = Ll(m). Thus G is an m x r binary matrix. 

1. Divide X into ^ = n" disjoint blocks, each with length 

2. For each block Xi,i G [£], compute Yi = BitExt(Aj). 

3. Let Y = (Yi, • • • ,Yr) be the binary vector in F^. Compute Z = GY where all operations 
are in F 2 . 


We have the following theorem. 

Theorem 3.6. There exists a constant c such that for any constant 5 > 0 and all n G N, there exists 
an explicit extractor BFExt : {0,1}"' —>■ {0,1}"* such that for any {q,t,'y) non-oblivious bit-fixing 
source X on n bits with q < , t > clog^^ n and 7 < we have that 

\BfExt{X) - Um\ < e, 

where m = and e = 

Proof. Let the set of “bad” bits in X be Q, and the rest of the “good” bits be Q. Thus \Q\ = q < 

. Therefore, any block Xi forms a ( 9 , t, 7 ) non-oblivious bit-fixing source on n' = = n^~4 

bits. 
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Note that g < 4 )(i ^ 4 ) = n'^ . Thus by Theorem 3.1 we have that each Yi is 

n^(^)-close to uniform. Moreover since q < we have that Iq^i^.y(BitExt) < q/n'^~~ < . 

For any z € [£], the above means that with probability at least 1 — n~~s over the fixing of X^nQ, 

we have that Yi is fixed regardless of what Xi n Q is. Thus, it is also true that with probability 

at least 1 — n ^ over the fixing of Q, we have that Tj is fixed regardless of what Q is. By a 

_M I —I — 

union bound, with probability at least 1 — n 8 n 4 =l — re » over the fixing of Q, we have that 
(Yi, • • • , Yi) is fixed and thus Y = (Yi, • • • , Y,,) is also fixed. 

Now consider a different distribution X' where the bits in Q have the same distribution as X, 
while the bits in Q are fixed to 0 independent of Q. Let Y' = (Y/, • • • , Y/) and Z' be computed 
from X' using the same algorithm. Then, by the above argument, we have that 

|Y — Y'l < re “8 and thus also \Z — Z'\ < re“ 8 . 

Now consider Y',Y',Z'. Note that by Theorem 3.3 X' is n *7 < 1/re-close to a distribution 
where the bits in Q are truly t-wise independent, and the bits in Q are fixed to 0. Thus from now 
on we will think of X' as this distribution, since this only adds at most 1/n to the error. 

Let X" be another distribution where the bits in Q are completely uniform and independent, 
and the bits in Q are fixed to 0. Let Y”, Z" be the corresponding random variables obtained from 
X” instead of X'. 

Take any non-empty subset S C [m], and consider the random variable Vg = 0jg5 Z[. 

Note that 


ri = 0 z' = 0 G.i" = (G.)r', 

ieS ieS i&S 

where Gi stands for the z’th row of the matrix G. Since G is the generating matrix of a [r, m, d ]2 
code, for any non-empty subset S C [m], we have that ^ codeword. Thus it has at least 

d I’s. 

Now let Vg be the corresponding random variable obtained from X". Note that by Theorem 3.1 
each Yl' is re“^^^^-close to uniform, and now the are independent of each other (since they 

are functions applied to independent blocks of X"). Therefore by Lemma 2.3 we have that 

\E[Vs] - 1/2| < 

Moreover, observe that Vg is the parity of at most r = 0{m) Y^s. Since parity on r bits can 
be computed by a depth-2 AC^ circuit (i.e., a DNF or CNF) of size 2^^^^ = and every Y/ is 

computed by a depth-4 AC*^ circuit with size re'^^^), we have that Vg can be computed by a depth-6 
AC^ circuit with size at most 2‘^(™')poly(n). 

We choose m = /3f^} for some small constant 0 < /3 < 1, so that rre = (since 

t < n) and r = O(rre) < re“. Note that now the AC^ circuit size is at most 2‘^(”^)poly(n) ^ 20 {m) 
since = n(logre). Note that the bits in Q are fixed to 0, thus Vg is computed by a depth-6 AC*^ 
circuit with inputs from Q. 

Setting e = 2“™ in Theorem 3.2, we see that to e-fool a depth-6 kOP circuit with size at most 
20 (m), guffices to take 0(log(2'^(™')))^^ = 0(?re^^)-wise independent distributions. By setting /3 
to be small enough, we can make this number less than t. Since in X\ the bits in Q are t-wise 
independent, we have that 


\E[V^]-E[V^']\<2-^. 

Thus 

\E[Vs] - 1 / 2 | < + 2 "™ < 2 ^“”". 

Note that this holds for every non-empty subset S C [m]. Thus Z is e'-biased for linear tests 
with e' < 2 ■ 2^“”^ = 2^“™. By the Lemma 2.5 we have that 

\z' -Um\< 

Adding back the errors, we have 

1^ - Um\ < + 1/n + n“i = 


The following theorem is implicit in [Lil5] and explicit in [CZ15] 

Theorem 3.7 ([Lil5, CZ15]). There exist constants 6,c' > 0 such that for every G N there 
exists a polynomial time computable function reduce : {0,1}"' x {0,1}” —?> {0,1}'^ with N = 
satisfying the following property: if X, Y are two independent (n, k) sources with k > cft^ log^ n, 
then 


Pr [reduce(Ai, y) is a {q,t,'y) non-oblivious bit-fixing source ] > 1 — n 
y^y 

where q = and 7 = 

Together with Theorem 3.6 this immediately implies the following theorem. 

Theorem 3.8. There exists a constant C > 0 such that for all n G N, there exists a polynomial 
time computable function 2Ext ; {0,1}” x {0,1}” —)■ {0,1}™' satisfying the following: if X,Y are 
two independent (n, k) sources with k > log*^ re, then 

|(2Ext(A,y),y)-(c/^,y)| <e, 

where m = and e = 

Proof. We first use Theorem 3.7 to obtain a {q, t, 7 ) non-oblivious bit-fixing source Z on N = 
bits, with q = and 7 = We then apply the extractor for such sources in Theorem 3.6. 

By choosing C large enough we can ensure that k > c't^ log^ re and t > clog^^ re (e.g., take C = 87). 
Thus we see that t = . 

Therefore, by Theorem 3.6 the extractor can output bits with error re“^^^^. Since 

the reduction succeeds with probability 1 — re"^^^^) over the fixing of Y, the extractor is also strong 
in Y and the final error is e = re“^*^^^ -|- re“^^^^ = ■ 
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4 Conclusions and Open Problems 


Constructing explicit two-source extractors is a challenging problem. Through a long line of re¬ 
search, the recent breakthrough result of Chattopadhyay and Zuckerman [CZ15] has finally brought 
us close to the optimal. In this paper we managed to improve the output length of the (strong) 
two-source extractors in [CZ15] from 1 to but the error remains The most obvious 

open problems are to improve the output length (say to Q(k)) and the error (say to exponentially 
small). 

Both of these two problems seem challenging and requiring new ideas. Specihcally, the current 
approach is to first reduce two independent sources to a {q, t, 7 ) non-oblivious bit-fixing source, and 
then apply a deterministic extractor to such sources. This reduction step (implicit in [Lil5] and 
explicit in [CZ15]) inherently depend on the alternating extraction method developed in previous 
work on independent source extractors). As a result, this technique, together with the requirement 
that 7 < seems to imply that t can be at most fe" for some constant a < 1. As t can be 

viewed as the entropy of the {q, t, 7 ) non-oblivious bit-fixing source, it seems that we can extract 
at most t = /i;Omega(l) 

Second, the extractor for non-oblivious bit-hxing source crucially depends on resilient functions, 
where the analysis is done by bounding the influence of a coalition of variables. If the non-oblivious 
bit-fixing source has length (to ensure polynomial time computability), then even one bit can 
have influence n(log by the result of Kahn, Kalai and Linial [KKL 88 ]. Therefore we cannot 

hope to get error through this approach. However, there is indeed one way to get smaller 

error. That is to increase the length of the non-oblivious bit-fixing source. Indeed, by increasing 
the length to we can get error but then the time for computing the extractor will be 

as well. 

Finally, an interesting observation of our work is that actually the bias of the one bit extractor 
in [CZ15] is not very important (in [CZ15] it has bias Indeed, even if it only has constant 

bias, after the step of using the generating matrix G, we can see that the XOR of H(m) copies 
will have bias . However, at this moment this observation doesn’t seem to help improve the 

parameters. 
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